Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

ci: cilium scale pipeline #2085

Merged
merged 75 commits into from
Aug 14, 2023
Merged

ci: cilium scale pipeline #2085

merged 75 commits into from
Aug 14, 2023

Conversation

camrynl
Copy link
Contributor

@camrynl camrynl commented Jul 27, 2023

Reason for Change:

This PR creates a new cilium scale pipeline to test a cluster at 1000 nodes. It adopts NPM's existing scale test to create nginx deployments and services, and it uses the existing connectivity test. It uses apachebench and netperf to test the throughput and gathers cpu memory usage. The results are published as pipeline artifacts. We will reuse the same cluster for all builds, and at the end of each run the cluster is scaled back down to 5 nodes.

Issue Fixed:

Requirements:

Notes:

@camrynl camrynl added the ci Infra or tooling. label Jul 27, 2023
@camrynl camrynl requested a review from a team as a code owner July 27, 2023 16:49
@camrynl camrynl requested review from jpayne3506 and vipul-21 July 28, 2023 20:48
@camrynl camrynl force-pushed the camryn/ciliumscaletest branch from b783de2 to e611c08 Compare August 9, 2023 22:05
@camrynl camrynl enabled auto-merge (squash) August 9, 2023 22:07
#!/bin/bash
# find the nodes with netperf pods and assign test vars
node_found=0
for node in $(kubectl get nodes -o name);
Copy link
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

We can limit this result to three if we use the label selector netperf=true?

Copy link
Contributor Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

yes, in label-nodes.sh I cut off the netperf=true labeling once 3 nodes have it

Copy link
Contributor

@jpayne3506 jpayne3506 left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Great work Camryn! Lgtm.

@camrynl camrynl merged commit f712771 into master Aug 14, 2023
@camrynl camrynl deleted the camryn/ciliumscaletest branch August 14, 2023 22:37
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
ci Infra or tooling.
Projects
None yet
Development

Successfully merging this pull request may close these issues.

4 participants